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Substitute Specification; 

The entire specification (including the abstract) is presented No changes have been made 

to the specification, 

METHOD FOR IMAGE PROCESSING BY UNSHARP MASKING 

5 

Background of Invention 

1. Field of the Invention 

The present invention relates to a method for adjusting an image signal by a 
1 0 processor, and more specifically, to a method for image processing by unsharp masking, 



2. Description of the Prior Art 

Please refer to Fig.l and Fig.2. Fig.l is a block diagram illustrating a conventional 
image processing system 10 and Fig.2 illustrates an image 14 of the image processing 
15 system 10 in Fig, I. The image processing system 10 includes a memory 12 for storing 
programs and the image 14 to be processed, and a processor 16 for executing the 
programs stored in the memory 12. The image 14 includes a plurality of pixels 18 
arranged in matrix form. The image 14 is composed of an image area 20 with specific 
features and a boundary area 22 around the image area 20. 

20 

A goal of image processing is to have the features of the image area 20 stand out 
while keeping the image area 20 and the surrounding edge area 22 in harmony. An 
adjustment of the image parameters of the whole image 14 will sacrifice some features 
that are not within the image area 20 or cause distortion of the image area 20. For this 
25 reason, some image processing methods adjust only the image parameters of the 
surrounding edge area 22 in order to emphasize the high frequency characteristic of the 
edge of the image. 
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The unsharp mask method is a method based on the concept mentioned above. 
According to the method, first unsharpen an image to obtain a low frequency element of 
the image, then subtract the unsharpened image from the original image to obtain a high 
frequency element of the original image. Apply a convolution operation to the remaining 
5 high frequency image and eventually add the subtracted low frequency image to the 
remaining high frequency image to complete the process. Although the unshap mask 
method can sharpen the edge of the image, it also increases the high frequency element of 
the image and raises the luminance of the whole image, making it lighter. In addition, 
according to the conventional unsharp mask method, while applying the convolution 
10 operation to the high frequency image and adding back the subtracted low frequency 
image, because two operation intensive calculations are required to be processed 
simultaneously, processing time and image processing cost are increased, 

» 

Summary of Invention 

♦ 

15 

It is therefore a primary objective of the present invention to provide a method for 
adjusting an image signal by a processor to solve the problem mentioned above. 

Briefly summarized, a method for adjusting an image signal by a processor includes 
20 providing a first low pass filter and a second low pass filter; generating an energy ratio of 
a band-pass image signal and the image signal according to the standard deviation of the 
low pass signal of the first low pass filter and the low pass signal of the second low pass 
filter; providing an image adjustment parameter and generating a weighting coefficient of 
the image signal according to the energy ratio and the image adjustment parameter; 
25 generating a third low pass filter according to the weighting coefficient of the image 
signal, the image adjustment parameter, the low pass signal of the first low pass filter, and 
the low pass signal of the second low pass filter; and adjusting the image signal according 
to the image signal and the third low pass filter. 

3 



PAGE 6/35 * RCVD AT 6/2012007 1 :49:16 AM [Eastern Daylight Time] * SVR:USPTO€FXRF-5/20 ■ DMS:2738300 * CSID:8064986673 « DURATION (mm-ss):13-04 



To: USPTO Page 7 of 35 2007-06-20 05:49:27 (GMT) 8064986673 From: Winston Hsu 



Appl.No. 10/605,250 

Amdl. dated June 20, 2007 

Reply to Office action of April 05, 2007 



These and other objectives of the present invention will no doubt become obvious to 
those of ordinary skill in the art after reading the following detailed description of the 
preferred embodiment that is illustrated in the various figures and drawings. 

5 

Brief Description of Drawings 

Fig. 1 is a bloek diagram illustrating a conventional image processing system. 
Fig.2 illustrates an image of the image processing system in Fig. 1 . 
10 Fig.3 is a bloek diagram illustrating an image processing system according to the 

present invention. 

Fig.4 illustrates a flowchart of image processing by the image processing system 
according to the present invention. 

Fig,5 illustrates a subtraction between a low pass filter signal h x {x>y) of the first 
15 low pass filter and a low pass filter signal h t (x,y) of the second Sow pass filter in 
frequency domain. 

Fig.6 illustrates a flowchart for image processing by an image processing system 
according to the second embodiment of the present invention. 

Fig.7 illustrates a subtraction between the unit pulse signal S(x 9 y) and a low pass 
20 filter signal h 2 (x>y) of the second low pass filter in frequency domain. 

Detailed Description 

Please refer to Fig.3. Fig.3 is a block diagram illustrating an image processing 
25 system 30 according to the present invention. The image processing system 30 includes a 
memory 32 for storing an image processing program 34 and an image 36 to be processed. 
The image processing program 34 includes a first low pass filter 38 and a second tow pass 
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filter 40 implemented using software. The first low pass filter 38 and the second low pass 
fitter 40 can also be hardware circuits. The image processing system 30 further includes 
an image processor 42 for executing the image processing program 34 stored in the 
memory 32, and an input device 44 tbr image parameter settings. 

5 

Please refer to Fig.4 showing a flowchart for image processing by the image 
processing system 30 according to the present invention. The flowchart in Fig.4 includes 
following steps: 

1 0 Step 1 00: Please refer to Fig.5 showing a subtraction between a low pass filter signal 

h^x.y) of the first low pass filter 38 and a low pass filter signal h 2 (x>y) 
of the second low pass filter 40, shown in frequency domain. Obtain a 
band-pass filter signal h(x,y) by subtracting die tow pass fitter signal 
h 2 (x r y) of the second tow pass filter 40 from the low pass filter signal 

15 h){x,y) of the first tow pass fitter 38. Define the signal resulting from 

convolving the band-pass filter signal h(x,y) and an image signal 
■ /(*, y) as a band-pass image signal h(x,y)®l(x>y), wherein <8> means 
convolution. 

Step 102: Generate an energy ratio of the band-pass image signal and the 



t 



20 image signal according to the standard deviation of the low paSsS fitter 

signal A, y) of the first low pass filter 38 and the low pass filter signal 

h^x.y) of the second low pass filter 40. The energy ratio -~ of the 

band-pass image signal h(x.y)<&l(x >y ) and the image signal l{x>y) is 

12 1 

equivalent to rf 7^1 + Wherein 1S m>t 

2ff^y-i-cr> ) 4*w; 
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15 



equivalent to er 2 . 

Step 104: Provide a maximum image distortion ratio and divide it with the energy 

ratio -Z&L to obtain a maximum image adjustment weighting coefficient 
£ f 

C 2 | mwt . Further provide an image adjustment normalized value between 0 
and I so that an image adjustment parameter C l can be obtained by 
multiplying the maximum image adjustment weighting coefficient C 2 \ 

with the image adjustment normalized value. A user can input the image 
adjustment normalized value by the input device 44 of the image 
processing system 30 to obtain the image adjustment parameter C\ . 
Step 106: Generate a weighting coefficient C, of the image signal according to the 

E 

energy ratio — — and the image adjustment parameter C\, wherein 



ma* 



E 



SSL 



20 



Step 108: Obtain a third low pass filter 41 h 3 (x,y) according to the weighting 
coefficient C, of the image signal, the image adjustment parameter 
the low pass filter signal /i,(*,y) of the first low pass filter 3&, and the 
low pass niter signal h 2 (x,y) of the second low pass filter 40, wherein 
h^(x i y)^C,S(x 9 y) + C 2 [h t (x 9 yyh i (x 9 y)] 7 and <?(*,y) is a delta 
function. 

Step i 10: Finally, convolute the third low pass filter 41 fyfoy) with the image 
signal /(*>y) to obtain an adjusted image signal 
J\(x»y)~ K( x *y)® l( x *y)» wherein <S> means convolution. 
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The image processing method according to the first embodiment of the present 
Invention includes capturing the high frequency portion of the image 36 and applying a 
convolution operation, i,e. C 2 [h(x,y)^ l(x y y)} , Then adding The weighting coefficient of 
the original signal, he. C t l(x 9 y) 9 so that the high frequency portion can be emphasized. 
5 Further imposing a restriction according to conservation of energy, i.e. 
(E A =C\E t +C 2 E h &)A.(E A =£"/)♦ and calculating an adjusted image signal j\{x,y) 

under the condition that the energy of the adjusted image signal f t (x,y) is equivalent to 
the energy of the original image signal l(x,y), 

10 More specifically, under the condition that a limited signal has the same energy in 

either time domain and space domain according to the Rayieigh's theorem, calculate the 

energy ratio of the band-pass image signal h(x,y)® l(x,y) and the image signal 

I{x>y) , wherein ^.^__ p; ^ + _l r , „, and a t represent 

respectively the standard deviations of the low pass filter signal fc,(*>y) of the first low 
pass filter 38 and the low pass filter signal h^y) of the second low pass filter 40, and 

F 

t7, is not equivalent to <r 2 so that — will not be zero and the band-pass filter 

signal h(x,y) can capture the high frequency portion of the image 36. Then obtain 
/•* 

C, - 1 - C 2 ~ L on the bases that E r = C, E f + C 2 E m . 
E t 

20 Subsequently, while determining the image adjustment parameter C 2 and the 

weighting coefficient C, of the image signal in Step 104 and Step 106, a maximum 
image distortion ratio must first be determined, that is the maximum acceptable energy 



15 
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decay of the unprocessed low frequency portion such as the image area 20 in Fig.2. For 
instance, if the energy decay of the image area of the image 36 is to be limited to 5%, the 
minimum weighting coefficient of the image signal can be determined as 
C,| mm = 1 - 0.05 ■- 0.95 and the maximum image adjustment weighting coefficient can be 

5 determined as C, L„ - ] . For the user's convenience, it is possible to provide the 

image adjustment normalized value between 0 and 1 normalized from the image 
adjustment parameter C 2 by the input device 44 of the image processing system 30 so 
that the image adjustment parameter C 2 can be obtained by multiplying the maximum 
image adjustment weighting coefficient with the Image adjustment normalized 

10 value. That is, when a user inputs 1 as the normalized value by the input device 44, the 

image adjustment parameter C 2 is ~=™~- , the weighting coefficient C, of the 

image signal is 0.95, and the adjusted energy amplitude will be 5% in maximum. 
Alternatively, when the user inputs 0 as a corresponding weighting coefficient by the 
input device 44, the image adjustment parameter C 2 is 0, the weighting coefficient C\ 
15 of the image signal is 1, and the adjusted energy amplitude will be 0% in minimum, 
which means not to adjust the image 36. 

Continuously evaluate the third low pass filter 4l h 3 (x,y) using the first filter 
38, the second filter 40, the above-mentioned C x and C z , and the equation 
20 hfety)~C x 5(x,y)+C 2 \hfa is a unit pulse signal. 

Convolute the third low pass filter 41 and the image signal to obtain the 
adjusted image signal /,(*,.)>)- A 3 (x s v)® T{x 9 y). hi such a way the luminance 
change in the prior an can be improved. 



8 
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Please refer to Fig,6 showing a flowchart for image processing by an image 
processing system 30 according to the second embodiment of the present invention. The 
difference between the two embodiments is that in the second embodiment, to simplify 
the calculation, a second low pass filter 40 and a unit pulse signal are used instead of the 
5 first low pass filter 3S. However, when inputting an image adjustment value, the second 
embodiment will not show a linear transition as in the first embodiment. The flowchart in 
Fig.6 includes following steps: 

Step 1 12: Please refer to Fig.7 showing a subtraction between the unit pulse signal 
10 S(x,y) and a low pass filter signal h 2 (x,y) of the second low pass filter 

40 in frequency domain. Determine a high pass filter signai h f {x f y) 
obtained by subtracting the low pass fitter signal h 2 {x,y) of the second 
low pass filter 40 from the low pass filter signal A,(x,jk) of the first low 
pass filter 38, Define the signal resulted by convolving h\x h y) and an 
15 image signal l{x>y) as a high pass image signal h'(x, v)<S> l{x> v). 

F 

Step 114: Generate an energy ratio — of the high pass image signal and the 

image signal according to the standard deviation of the low pass filter 

F 

signal hJx.y) of the second low pass filter 40. The energy ratio — £ aL 
of the high pass image signal h'{x, y)® l{x y y) and the image signal 



3 



f 3 



20 ?(x,y) is equivalent to 1 - , wherein <r 2 is larger than . 

Step 1 16: Provide a maximum image distortion ratio and divide it with the energy 

ratio to obtain a maximum image adjustment weighting coefficient 

E. 
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C 4 | ro , v . Further provide an image adjustment normalized value between 0 

and I so that an image adjustment parameter C A can be obtained by 

multiplying the maximum image adjustment weighting coefficient C 4 

with the image adjustment normalized value. A user can input the image 
adjustment normalized value using an input device 44 of the image 
processing system 30 to obtain the image adjustment parameter C 4 . 
Step ll 8: Generate a weighting coefficient C % of the image signal according co the 

energy ratio — ^ and the image adjustment parameter C 4 , wherein 



F 



10 Step 120: Obtain a fourth low pass filter 46 h 4 {x>y) according to the weighting 

coefficient C 5 of the image signal, the image adjustment parameter C 4 , 
and the low pass filter signal h z (x,y) of the second low pass filter 40, 
wherein ht(x 9 y)=C z 5(x 9 y)+Ct[d(x,y)- h 2 (x>y)] and #(x,y) is the 
unit pulse signal. 

15 Step 122: Convolute the third low pass filter 46 h 4 (x,y) and the imago signal 

v)to obtain an adjusted image signal f 2 (x>y) = h 4 (x t y)® i(x,y) . 

The image processing method according to The second embodiment is essentially the 
same to that of the first embodiment. The method is to capture the high frequency portion 
20 of the image 36 and apply a convolution operation, i.e. C A [h'{x,y)® l{x.y% then add 
the weighting coefficient of the original signal, i.e. C s J{x,y) 9 so that the high frequency 
portion is emphasized. Additionally, impose a restriction according to the conservation of 
energy, i.e. [E A = C r E f + C A E M ^)^(E A ■ and calculate an adjusted image signal 

JO 
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f 2 (x>y) under the condition that the energy of the adjusted image signal f 7 {x,y) is 
equivalent to the energy of the original image signal f(x,y) . 

In the same manner, under the condition that a limited energy signal has the same 
5 energy in either time domain or space domain according to the Rayleigh's theorem, 

E 

calculate the energy ratio ' h ' m of the high pass image signal h'(x,y)<8> l(x 7 y) and the 

E 3 / 3 

image signal J (*, y), wherein « 1 - — ~ , and rr., is larger than I— so that 

w ilt be larger than zero, in other words, the band-pass filter signal 

E r 

h'(x 9 y)<8 !{*>}>) is able to capture the high frequency portion of the image 36. Since the 
10 flowchart of the second embodiment is similar to that of the first embodiment, farther 
description is hereby omitted. 

In contrast to the prior art, the present invention is capable of sharpening the edge of 
an image while maintaining the luminance, so mat the disadvantage of the prior art which 

15 makes the image lighter due to the increased high frequency portion can be improved. 
Additionally, in contrast to the operation intensive calculations caused by twice 
adjustments on image signals required by the prior art, the method according to the 
present invention only calculates weighted parameters and filter signals in space domain 
first. In such a manner the operations are reduced and, accordingly, the cost and time of 

20 image processing is reduced at the same time. 

Those skilled in the art will readily observe that numerous modifications and 
alterations of the device may be made while retaining the teachings of the invention. 
Accordingly, the above disclosure should be construed as limited only by the metes and 

n 
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bounds of the appended claims. 
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